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[57] ABSTRACT 

A coding system for transmitting stereo image data, wherein 
an image for the left eye is disposed in odd fields and an 
image for the right eye is disposed in even fields, respec- 
tively. Frames Fl. F2, F3 and F4 are sequentially coded in 
an order of I picture, B picture. P picture and B picture. The 
picture in each frame is coded by adaptively switching 
between a frame prediction mode or field prediction mode or 
a frame DCT mode or field DCT mode. Thereby, the parallax 
can be efficiently coded. 

26 Claims, 23 Drawing Sheets 
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FIG. 9 
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FIG. 10 
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FIG. 11 
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FIG. 12 
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FIG. 15 
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FIG. 16 
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FIG. 21 
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STEREOSCOPIC CODING SYSTEM 
BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an image signal recording 5 
method and image signal recording unit, image signal repro- 
ducing method and image signal reproducing unit, image 
signal coding method and image signal coding unit, image 
signal decoding method and image signal decoding unit and 
image signal recording medium suitably used in recording a 10 
stereoscopic dynamic image signal in a recording medium 
such as a magneto-optic disk and magnetic tape for example, 
reproducing it to display on a stereoscopic display, trans- 
mitting it from the sending side to the receiving side via a 
transmission path and receiving it on the receiving side to 15 
stereoscopically display through a TV conference system, 
TV telephone system, broadcasting equipment and the like. 

2. Description of the Related Art 

FIG. 22 shows a principle of stereoscopic image. Gener- ^ 
ally a stereoscopic is a technique for bringing about a 
stereoscopic feeling in an image by giving different images 
to left and right human eyes by taking account of its parallax. 
In FIG. 22. an object 203 is projected on a screen 204 from 
each point of view of a left eye 201 and right eye 202 to ^ 
obtain an image for left eye 201 and image for right eye 206. 
Accordingly, it becomes possible to stereoscopically show 
the object 203 as if it is floating out of the screen 204 even 
when the object 203 does not actually exist by giving the 
image for left eye 205 to the left eye 201 and the image for 3Q 
right eye 206 to the right eye 202 by some technique. 

FIG. 23 shows an example of the stereo image thus 
obtained. As shown in the figure, the image for left eye 205 
is disposed in odd fields and the image for right eye 206 is 
disposed in even fields, respectively, utilizing the interlace- 35 
scanned fields. A heavy interlaced structure corresponding to 
the parallax is seen in this stereo image. That is, the image 
for left eye 205 and image for right eye 206 which are 
originally a continuous one image (line) are shifted consid- 
erably to the left and right. Conventionally, the image thus ^ 
produced has been recorded as it is in analog in a recording 
medium such as a magnetic tape, as shown in the VS. Pat. 
No. 4,523,226 patented on Jun. 11, 1985 for example. 

By the way, if a high efficient coding is applied to the 
image having a heavy interlaced structure such as shown in 45 
FIG. 23, a coding efficiency stagnates and an image quality 
drops because a very high frequency is concentrated around 
the edge of the object 

Accordingly, it is an object of the present invention to 
solve the aforementioned problem by providing means for 50 
efficiently coding even an image whose edge is heavily 
disturbed due to the interlacing, without degrading the 
image quality. 

SUMMARY OF THE INVENTION 

An image signal recording unit of the present invention 
comprises: 

first producing means (e.g., video cameras 41 and 42 in 
FIG. 5) for producing an image for left eye and image 
for right eye taking account of a parallax of the both 50 
eyes by stereoscopic; 

second producing means (e.g., a composite circuit 43 in 
FIG. 5) for producing a stereo image signal by dispos- 
ing the image for left eye and image for right eye 
respectively in one or another of first and second fields; 65 

coding means (e.g., an encoder 18 in FIG. 6) for com- 
pressing and coding the stereo image signal; and 
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recording means (e.g., a recording circuit 19 in FIG. 6) for 
digitally recording the compressed and coded signal in 
a recording medium. 

An image signal decoding unit of the present invention 
comprises: 

reproducing means (e.g.. a reproducing circuit 30 in FIG. 
6) for reproducing a recorded signal from the image 
signal recording medium in which the stereo image 
signal produced by disposing the image for left eye and 
image for right eye respectively in one or another of the 
first and second fields of the TV signal is coded and 
digitally recorded; 

decoding means (e.g., a decoder 31 in FIG. 6) for decod- 
ing the reproduced signal; 

converting means (e.g., a format converting means 32 in 
FIG. 6) for converting the decoded signal to a TV 
signal; 

displaying means (e.g., a CRT 101 in FIG. 20) for 

displaying the converted TV signal; 
forbidding means (e.g., a left eye shutter 103 and right eye 
shutter 104 in FIG. 20) for synchronously forbidding 
the image for left eye from entering the right eye when 
the image for left eye is displayed on the displaying 
means and synchronously forbidding the image for 
right eye from entering the left eye when the image for 
right eye is displayed on the displaying means. 
An image signal coding unit of the present invention for 
producing the image for left eye and image for right eye 
taking account of the parallax of the both eyes by stereo- 
scopic; 

for producing the stereo image signal by disposing the 
image for left eye and image for right eye respectively 
in one and another of the first and second fields 
composing the frame of the TV signal; and 

for compressing and coding the stereo image signal, 
comprises: 

predictive coding means (e.g.. an operating section 53 
in FIG. 8) for dividing the stereo image signal with 
a unit of block in the frame and adaptively selecting 
either a first prediction mode in which the signals in 
the first and second fields are mixed or a second 
prediction mode in which the signals in the first and 
second fields are not mixed to predictively code the 
signal in the block; 
operating means (e.g., a DCT circuit 56 in FIG. 8) for 
implementing a predetermined operation on the pre- 
dictively coded signal; 
quantization means (e.g., a quantization circuit 57 in 
FIG. 8) for quantizing the . signal obtained by the 
operation; and 
variable length coding means (e.g.. a variable length 
coding circuit 58 in FIG. 8) for variable length 
coding the quantized signal. 
An image signal decoding unit of the present invention for 
decoding the signal transmitted by compressing and coding 
the stereo image signal in which the image for left eye and 
image for right eye produced by taking account of the 
parallax of the both eyes by stereoscopic are disposed 
respectively in one and another of the first and second fields 
composing the frame of the TV signal, comprises: 
variable length decoding means (e.g.. a variable length 
decoding circuit 82 in FIG. 13) for variable length 
decoding the input signal and for separating a predic- 
tion flag indicating that in which prediction mode the 
stereo image signal divided with the unit of block in the 
frame has been predictively coded, i.e., a first predic- 
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tion mode in which the signals in the first and second 
fields are mixed and a second prediction mode in which 
the signals in the first and second fields are not mixed, 
at the time of predictive coding; 
inverse quantization means (e.g., a inverse quantization 
circuit 83 in HG. 13) for inversely quantizing the signal 
variable length decoded by the variable length decod- 
ing means; 

inverse operating means (e.g., an IDCT circuit 84 in FIG. 
13) for implementing a predetermined operation inver- 
sive from that in coding on the signal inversely quan- 
tized by the inverse quantization means; 
producing means (e.g., a motion compensating circuit 88 
in FIG. 13) for producing a prediction error signal 
which corresponds to the signal in the block in either 
state of the state in which the signals in the first and 
second fields are mixed or the state in which the signals 
in the first and second fields are not mixed based on the 
prediction flag; and 
decoding means (e.g., an operator 86 in FIG. 13) for 
decoding the operated signal in the block by using the 
prediction error signal. 
When one group is formed by a plurality of frames, first 
and second fields of a first frame in the group may be both 
designated as I picture, first and second fields of a second 
frame may be both designated as B picture, first and second 
fields of a third frame may be both designated as P picture 
and first and second fields of a fourth frame and thereafter 
may be both designated as B or P picture alternately. 

According to the present invention, the image for left eye 
and image for right eye produced by the stereoscopic are 
disposed in one or another of the first field and second field 
of the television signal. Then, they are predictively coded or 
DCT transformed per every field. Or, they are predictively 
coded or DCT transformed adaptively per every field or 
frame. Accordingly, the stereo image may be efficiently 
coded without degrading its quality. 

The above and other advantages of the present invention 
will become more apparent in the following description and 
the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a drawing for explaining a principle of high 
efficient coding; 

FIG. 2 is a drawing for explaining types of pictures in 
compressing image data; 

FIG. 3 is a drawing for explaining the types of pictures in 
compressing image data; 

FIG. 4 is a diagram for explaining a principle far coding 
a dynamic image signal; 

FIG. 5 is a block diagram showing an exemplary structure 
of a system far producing a stereoscopic video signal; 

FIG. 6 is a block diagram showing an exemplary structure 
of an image coding unit and decoding unit; 

FIG. 7 is a diagram for explaining a format converting 
operation of a format converting circuit 17 in FIG. 6; 

HG. 8 is a block diagram showing an exemplary structure 
of an encoder 18 in FIG. 6; 

FIG. 9 is a diagram for explaining an operation of a 
prediction mode switching circuit 52; 

FIG. 10 is a diagram for explaining an operation of the 
prediction mode switching circuit 52; 

FIG. 11 is a diagram for explaining an operation of a DCT 
mode switching circuit 52; 
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FIG. 12 is a diagram for explaining an operation of the 
DCT mode switching circuit 52; 

FIG. 13 is a block diagram showing an exemplary struc- 
ture of a decoder 31 in FIG. 6; 
5 FIG. 14 is a diagram for explaining a coding of a stereo 
image using a frame/field prediction; 

FIG. 15 is a drawing for explaining an image for left eye 
of the stereo image; 

10 FIG. 16 is a drawing for explaining an image for right eye 
of the stereo image; 

FIG. 17 is a diagram for explaining a coding of a stereo 
image using a field prediction; 
FIG. 18 is a diagram for explaining a coding of a stereo 
15 image using a field prediction; 

FIG. 19 is a diagram for explaining a coding of a stereo 
image using a field prediction; 

FIG. 20 is a drawing showing an exemplary structure of 
20 a stereo image display system; 

FIG. 21 is a table for explaining an operation of an 
electronic shutter controller 102 in FIG. 20; 

FIG. 22 is a drawing for explaining a principle of stereo 
image; and 

25 FIG. 23 is a drawing showing an example of stereo image. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENT 

In a system for transmitting a dynamic image signal to a 

30 remote site such as a TV conference system or TV telephone 
system, the image signal is compressed and coded utilizing 
a line correlation or inter frame correlation of the video 
signal in order to efficiently utilize the transmission path. 

35 The use of the line correlation allows to compress the 
image signal by implementing a DCT (discrete cosine 
transformation) process for example. 

The use of the inter frame correlation allows to further 
compress and code the image signal For example, as shown 

4Q in FIG. 1, when frame images PCI, PC2 and PC3 are 
generated respectively at times tl, t2 and t3, a difference of 
the image signals of the frame images PCI and PC2 is 
calculated to generate PC12 and a difference of the frame 
images PC2 and PC3 is calculated to generate PC23. 

45 Because images of neighboring frames normally do not have 
such a big change, a differential signal becomes small when 
a difference of the both is calculated. Trien, a coding amount 
may be compressed by coding this differential signal. 
However, the original image cannot be restored just by 

50 transmitting the differential signal. Then, the image in each 
frame is designated as either one picture among three 
pictures of I picture, P picture and B picture to compress and 
code the image signal 
That is, as shown in FIG. 2 for example, image signals of 

55 17 frames from frame Fl through frame F17 are designated 
as a group of pictures as a unit of processing. Then, the 
image signal of the first frame Fl is coded as I picture, the 
second frame F2 is processed as B picture and the third 
frame F3 is processed as P picture, respectively. On and after 

60 the fourth frame F4 through the frame F17 are processed 
alternately as B picture or P picture. 

As the image signal of the I picture, the image signal of 
1 frame is transmitted as it is. Contrary to that, as the image 
signal of the P picture, basically a difference from the image 

65 signal of the preceding I or P picture is transmitted as shown 
in FIG. 2. Further, as the image signal of the B picture, 
basically a difference from an average value of both of the 
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preceding frame and succeeding frame is found and is coded digital signals are supplied to a frame memory 14 to be 
as shown in FIG. 3. stored. The frame memory 14 stores the luminance signal to 
FIG. 4 shows a principle of a method for thus coding the a luminance signal frame memory 15 and the color- 
dynamic image signal. As shown in the figure, because the difference signal to a color-difference signal frame memory 
first frame Fl is processed as I picture, it is transmitted onto 5 16, respectively. 

the transmission path as it is as transmission data FIX (intra A format converting circuit 17 converts the frame format 

image coding). Contrary to that because the second frame signals stored in the frame memory 14 into block format 

F2 is processes as B picture, the difference from the average signals. That is, as shown in FIG. 7, the video signal stored 

value of the preceding frame Fl and succeeding frame F3 is in the frame memory 14 is frame format data in which lines 

calculated and is transmitted as transmission data F2X. 10 of H dots per line are assembled by V. The format converting 

Explaining this process for B picture in more detail, there circuit 17 divides this one frame of signal into M slices with 

exist four kinds of processes. The first process is to transmit a unit of 16 lines. Then, each slice is subdivided into M 

data of the original frame F2 as it is as the transmission data macro-blocks. Each macro-block is composed of luminance 

F2X (SP1) (intra coding), which is the same process with signals which correspond to 16x16 pixels (dots) and this 

that of I picture. The second process is to calculate a 15 luminance signal is subdivided further into blocks Y[l] 

difference from the succeeding frame F3 and to transmit the through Y[4] with a unit of 8x8 dots. Then, a 8x8 dot Cb 

difference (SP2) (rearward predictive coding). The third signal and 8x8 dot Cr signal are caused to correspond to this 

process is to transmit a difference (SF3) from the preceding 16x16 dot luminance signal. 

frame Fl (forward predictive coding). The fourth process is The data thus converted into the block format is supplied 

to produce a difference (SP4) from an average value of the 20 from the format converting circuit 17 to an encoder 18 to be 

preceding frame Fl and the succeeding frame F3 and to encoded, Its detail will be described later with reference to 

transmit it as the transmission data F2X (bi-directional FIG. 8. 

predictive coding). The signal encoded by the encoder 18 is output to the 

Among those four methods, one which mimmizes the transimssionpamasabitsfreamltissuppUedtoarecording 

transmission data is adopted. circuit 19 for example and is recorded in the recording 

By the way. when the differential data is transmitted, a medium 3 as a digital signal, 

motion vector xl (motion vector between the frames Fl and The data reproduced from the recording medium 3 by a 

F2) between the image (prediction image) in the frame from reproducing circuit 30 is supplied to a decoder 31 in the 

which the difference is to be calculated (in the case of 3Q decoding unit 2 to be decoded. The detail of the decoder 31 

forward prediction), x2 (motion vector between the frames will be explained later with reference to FIG. 13. 

F3 and F2) (in the case of rearward prediction) or both xl and The data decoded by the decoder 31 is input to a format 

x2 (in the case of bi-directional prediction) is transmitted converting circuit 32 to be converted from the block format 

together with the differential data. to the frame format. Then, the frame format luminance 

For the frame F3 which is P picture, the differential signal 35 signal is supplied to and stored in a luminance signal frame 
(SP3) from the preceding frame Fl as a prediction image and memory 34 in a frame memory 33 and the color-difference 
a motion vector x3 are calculated and are transmitted as signal is supplied to and stored in a color-difference signal 
transmission data F3X (forward predictive coding). Or, the frame memory 35. The luminance signal and color- differ- 
data of the original frame F3 is transmitted as it is as the data ence signal read out of the luminance signal frame memory 
F3X (SP1) (intra coding). Ether of the methods which ^ 34 and color-difference signal frame memory 35 are con- 
lessens the transmission data is selected similarly to the case verted from digital to analog respectively by D/A converters 
of B picture. 36 and 37 and are supplied to and combined in a post- 

FIGS. 5 and 6 show exemplary structures of units for processing circuit 38. Then, it is output to and displayed on 

coding, u-ansmitting and decoding the stereoscopic dynamic a display such as a CRT, which will be described later with 

image signal based on the principle described above. Video 45 reference to FIG. 20. 

cameras 41 and 42 are disposed on the left and right Next the exemplary structure of the encoder 18 will be 

corresponding to the parallax of left and right human eyes to explained with reference to FIG. 8. The image data to be 

shoot a certain object Thereby, the video cameras 41 and 42 coded is input to a motion vector detecting circuit 50 with 

output video signals for left and right eyes, respectively. the unit of macro-block. The motion vector detecting circuit 

Those video signals are input to a composite circuit 43 to be 50 50 processes the image data in each frame as I picture, P 

composited. Thereby, the video signal for left eye is inserted picture or B picture following to a predetermined sequence, 

to odd fields of the interlaced structure for example and the How to process the image in each frame sequentially input 

video signal for right eye is inserted to even fields, respec- as either I, P or B picture is determined beforehand (for 

tively. The composite circuit 43 thus composites the video example, the group of pictures composed of the frames Fl 

signals in the odd and even fields having such interlaced 55 through F17 is processed as I, B. P, B, P, . . . B, P as shown 

structure and outputs to a coding unit 1 shown in FIG. 6. in FIGS. 2 and 3). 

The coding unit 1 codes the input video signal and Image data in a frame (e.g., frame Fl) to be processed as 

transmits it to a recording medium 3 as a transmission path. I picture is transferred to and stored in a forward original 

Then, a decoding unit 2 reproduces, decodes and outputs the image section 51a of a frame memory 51 from the motion 

signal recorded in the recording medium 3. 60 vector detecting circuit 50. image data in a frame (e.g.. frame 

In the coding unit 1, the input video signal is input to a F2) to be processed as B picture is transferred to and stored 

pre-processing circuit 11 wherein a luminance signal and in an original image section 51Z> and image data in a frame 

color signal (color-difference signal in the case of the present (e.g., frame F3) to be processed as P picture is transferred to 

embodiment) are separated which are then converted from and stored in a rearward original image section 51c. 

analog to digital respectively by AID converters 12 and 13. 65 In the next timin g, when an image in a frame to be 

The signals which have been converted from analog to processed as B picture (frame F4) or P picture (frame F5) is 

digital by the A/D converters 12 and 13 and have become input further, the image data of the first P picture (frame F3) 
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which has been stored in the rearward original image section 
51c is transferred to the forward original image section 51a, 
the image data of the next B picture (frame F4) is stored 
(overwritten) in the original image section 51b and the 
image data of the next P picture (frame F5) is stored 
(overwritten) in the rearward original image section 51c. 
This kind of operation is sequentially repeated. 

The signal of each picture stored in the frame memory 51 
is read out of it and is processed in a frame prediction mode 
or field prediction mode in a prediction mode switching 
circuit 52. That is, the video signal in which the image far 
left eye and image for right eye are respectively disposed in 
the odd and even fields is processed adaptively with the unit 
of field or frame, not processing always with the unit of 
frame like the prior art technology. 

Further, in an operating section 53, an operation for the 
intra-image prediction, forward prediction, rearward predic- 
tion or bi-directional prediction is carried out under the 
control of a prediction deterniining circuit 54. Which pro- 
cess is to be carried out among those processes is determined 
corresponding to a prediction error signal (a difference 
between a reference image to be processed and a prediction 
image). Id order far that, the motion vector detecting circuit 
50 produces an absolute sum (or square sum) of the predic- 
tion error signal used for this determination. 

Now the frame prediction mode and field prediction mode 
in the prediction mode switching circuit 52 will be 
explained. 

When the frame prediction mode is set, the prediction 
mode switching circuit 52 outputs four luminance blocks 
Y[l] through Y[4] supplied from the motion vector detecting 
circuit 50 as it is to the rear operating section 53. That is, in 
this case, data in the odd field lines and data in the even field 
lines are mixed in each luminance block as shown in FIG. 
9. In the frame prediction mode, the prediction is made with 
the unit of four luminance blocks (macro-block) and one 
motion vector corresponds to four luminance blocks. 

Contrary to that, in the field prediction mode, the predic- 
tion mode switching circuit 52 outputs the signal input from 
the motion vector detecting circuit 50 with the composition 
shown in FIG. 9 to the operating section 53 by composing 
the luminance blocks Y[l] and Y[2] among the four lumi- 
nance blocks only by dots of the odd field (image for left 
eye) lines for example as shown in FIG. 10 and composing 
the other two luminance blocks Y[3] and Y[4] by data of the 
even field (image for right eye) lines. In this case, one 
motion vector corresponds to the two luminance blocks Y[l] 
and Y[2] and the other one motion vector corresponds to the 
other two luminance blocks Y[3] and Y[4]. That is, the 
image for right eye and the image for left eye are separately 
processed in the field prediction mode. 

The motion vector detecting circuit 50 outputs the abso- 
lute sum of the prediction error in the frame prediction mode 
and that in the field prediction mode to the prediction mode 
switching circuit 52. The prediction mode switching circuit 
52 compares the absolute sums of the prediction errors in the 
frame prediction mode and in the field prediction mode, 
implements a processing which corresponds to either pre- 
diction mode whose value is smaller and outputs the data to 
the operating section 53. 

However, such processing is carried out actually in the 
motion vector detecting circuit 50. That is, the motion vector 
detecting circuit 50 outputs a signal having a composition 
corresponding to a determined mode to the prediction mode 
switching circuit 52 which outputs the signal as it is to the 
rear operating section 53. 
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By the way, the color-difference signal is supplied to the 
operating section 53 in the state in which the odd field 
(image for left eye) line data and even field (image for right 
eye) line data are mixed as shown in FIG. 9 in the case of 

5 the frame prediction mode. In the case of the field prediction 
mode however, the upper half portion (4 lines) of each 
color-difference block Cb and Cr is occupied by the color- 
difference signal in the odd fields (image for left eye) which 
correspond to the luminance blocks Y(l] and Y[2] and the 

10 lower half portion (4 lines) is occupied by the color- 
difference signal in the even fields (image for right eye) 
which correspond to the luminance blocks Y[3] and Y[4] as 
shown in FIG. 10. 
The motion vector detecting circuit 50 produces the 

15 absolute sum of the prediction error for determining which 
prediction of the intra-image prediction, forward prediction, 
rearward prediction or bi-directional prediction is to be 
carried out in the prediction determining circuit 54, as 
follows. 

20 

That is, as the absolute sum of the prediction error of the 
intra-image prediction, it finds a difference of an absolute 
value Isigma Aijl of a sum sigma Aij of signals Aij in the 
macro-block of the reference image and a sum sigma lAijl of 
the absolute value lAijl of the signal Aij in the macro-block. 
Further, as the absolute sum of the prediction error of the 
forward prediction, it finds a sum sigma lAij-Bijl of an 
absolute value lAij-Bijl of a difference Aij-Bij of the signal 
Aij in the macro-block of the reference image and a signal 

3Q Bij in the macro-block of the prediction image. The absolute 
value of the prediction error of the rearward prediction and 
bi-directional prediction is also found in the same manner 
with the case of the forward prediction (by changing the 
prediction image to a prediction image different from that in 

35 the forward prediction). 

These absolute sums are supplied to the prediction deter- 
niining circuit 54. The prediction detenriining circuit 54 
selects the smallest absolute sum among the absolute sums 
of the prediction error of the forward prediction, rearward 

43 prediction and bi-directional prediction as the absolute sum 
of the prediction error of inter prediction. It then compares 
the absolute value of the prediction error of the inter 
prediction with that of the intra-image prediction and selects 
one whose value is smaller to select a mode which corre- 

45 sponds to the selected absolute sum as a prediction mode. 
That is. if the absolute sum of the prediction error of the 
intra-image prediction is smaller, the intra-image prediction 
mode is set However, if the absolute sum of the prediction 
error of the inter prediction is smaller, a mode whose 

50 corresponding absolute sum is the smallest is selected 
among the forward prediction, rearward prediction and 
bi-directional prediction. 

Thus, the motion vector detecting circuit 50 supplies the 
signal in the macro-block of the reference image with the 

55 composition which corresponds to the mode selected by the 
prediction mode switching circuit 52 among the frame or 
field prediction mode to the operating section 53 via the 
prediction mode switching circuit 52 and detects a motion 
vector between a prediction image which corresponds to the 

$o prediction mode selected by the prediction deterniining 
circuit 54 among the four prediction modes and the refer- 
ence image to output to a variable length coding circuit 58 
and motion compensating circuit 65. As described above, for 
this motion vector, one whose corresponding absolute sum 

65 of the prediction error is smallest is selected. 

When the motion vector detecting circuit 50 reads the 
image data of I picture from the forward original image 
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section 51a, the prediction determining circuit 54 sets the absolute sum of the prediction error becomes small and the 
frame mode or intra-field (image) prediction mode (a mode DCT mode switching circuit 55 decides the mode so that the 
in which no motion is compensated) as a prediction mode coding efficiency becomes better, 
and switches a switch S3d in the operating section 53 to the The image data of I picture output from the DCT mode 
side of acontoct(a).Thereby,meiinagedataofIpictureis 5 switching circuit 55 is input to the DCT circuit 56 to undergo 
input to a DCT mode switching circuit 55. a DCT (discrete cosine transformation) process to be con- 
As shown in FIG. 11 or 12. this DCT mode switching verted into DCT coefficient. This DCT coefficient is input to 
circuit 55 outputs to a DCT circuit 56 the data of four a quantization circuit 57 to be quantized by quantization 
luminance blocks in a state in which the odd field (image for steps which correspond to a data storage amount (buffer 
left eye) lines and even field (image for rigfrt eye) lines are to storage amount) in a transmission buffer 59 and is then input 
mixed (frame DCT mode) or in a state in which they are to the variable length coding circuit 58. 
separated (field DCT mode). The variable length coding circuit 58 converts the image 
That is, the DCT mode switching circuit 55 compares a data supplied from the quantization circuit 57 (the data of I 
coding efficiency when DCT processing is implemented in picture in this case) into variable length codes such as 
the state in which the data in the odd fields (image for left 15 Huffman code corresponding to the quantization steps 
eye) and the even fields (image for right eye) are mixed and (scale) supplied from the quantization circuit 57 and outputs 
that when DCT processing is implemented in the state in it to the transmission buffer 59. 

which they are separated to select a mode having a better The quantization steps (scale) from the quantization cir- 

coding efficiency. In the case of the field DCT mode, the C uit 57, prediction mode (indicating which of the intra- 

image for right eye and the image for left eye are separately 20 image prediction, forward prediction, rearward prediction or 

processed. bi-directional prediction is set) from the prediction deter- 

For example, it composes the input signal in the manner mining circuit 54, motion vector from the motion vector 

as shown in FIG. 11 in which the odd field (image for left detecting circuit 50, prediction flag (indicating which of the 

eye) lines and even field (image for right eye) line are mixed, frame prediction mode or field prediction mode is set) from 

calculates a difference of the signals in the vertically neigh- 25 the prediction mode switching circuit 52 and DCT flag 

boring odd field (image for left eye) line and the even field (indicating which of the frame DCT mode or field DCT 

(image for right eye) line and finds its sum (or square sum) mode is set) output from the DCT mode switching circuit 55 

of absolute values. are input to the variable length coding circuit 58 and they are 

Or, it composes the input signal in the manner as shown ^ also variable length coded, 

in FIG. 12 in which the odd field (image for left eye) and The transmission buffer 59 temporarily stores the input 

even field (image for right eye) lines are separated, calcu- data and outputs the data corresponding to the storage 

lates a difference of signals between vertically neighboring amount to the quantization circuit 57. When the data residual 

odd field (image for left eye) lines and a difference of signals amount in the transmission buffer 59 increases up to the 

between even field (image for rigjit eye) lines and finds a 35 allowable upper limit value, the transmission buffer 59 

sum (or square sum) of respective absolute values. lowers a data amount of quantized data by increasing the 

Further, it compares the both (absolute sums) and sets a quantization scale of the quantization circuit 57 by a quan- 

DCT mode which corresponds to the smaller value. That is, tization control signal. When the data residual amount 

if the former is smaller, it sets the frame DCT mode and if reduces to the allowable lower limit value contrary to that, 

the latter is smaller, sets the field DCT mode. ^ the transmission buffer 59 increases the data amount of the 

It then outputs data in a composition which corresponds quantized data by reducing the quantization scale of the 

to a selected DCT mode to the DCT circuit 56 and outputs quantization circuit 57 by the quantization control signaL 

a DCT flag indicating the selected DCT mode to the variable Thus an overflow or underflow of the transmission buffer 59 

length coding circuit 58, a DCT block reordering circuit 62 is prevented. 

and the motion compensating circuit 65. 45 The data stored in the transmission buffer 59 is then read 

As it is apparent when the prediction mode in the predic- out with a predetermined timing, is added a parity for ECC, 

tion mode switching circuit 52 (FIGS. 9 and 10) and the is modulated for example by EFM and is recorded in the 

DCT mode in the DCT mode switching circuit 55 (FIGS. 11 recording medium (disk 68). 

and 12) are compared, the data structure of the both in each On the other hand, the data of I picture output from the 

mode is substantially the same concerning to the luminance 50 quantization circuit 57 is input to an inverse quantization 

blocks. circuit 60 and is inversely quantized corresponding to the 

When the frame prediction mode (the mode in which the quantization steps supplied from the quantization circuit 57. 

odd lines (image for left eye) and even lines (image for right The output of the inverse quantization circuit 60 is input to 

eye) are mixed) is selected in the prediction mode switching an IDCT (inverse DCT) circuit 61 to undergo an inverse 

circuit 52, the frame DCT mode (the mode in which the odd 55 DCT process and is input to the DCT block reordering 

lines (image for left eye) and even lines (image for right eye) circuit 62. The DCT block reordering circuit 62 reorders the 

are mixed) is likely to be selected also in the DCT mode input data corresponding to the prediction flag supplied from 

switching circuit 55 and when the field prediction mode (the the prediction mode switching circuit 52 and the DCT flag 

mode in which data in the odd fields (image for left eye) and supplied from the DCT mode switching circuit 55. 

even fields (image for right eye) are separated) is selected in 60 That is, when the frame prediction mode is set in the 

the prediction mode switching circuit 52, the .field DCT prem^on mode switchmgeirem^ 52, the data read out of the 

mode (the mode in which data in the odd fields (image far motion compensating circuit 65 and is supplied to the 

left eye) and even fields (image for right eye) are separate) operating section 53 is in the state in which the data of the 

is likely to be selected also in the DCT mode switching odd fields (image for left eye) and even fields (image for 

circuit 55. 65 m mixed. This data is supplied also to an operator 

However, it is not always the case and the prediction 63. Due to that, while the DCT block reordering circuit 62 

mode switching circuit 52 decides the mode so that the outputs the data supplied from the IDCT circuit 61 to the 
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operator 63 as it is when the frame DOT mode is set, it in the frame memory 64 is read and is motion compensated 
reorders the data when the field DCT mode is set so that the by the motion compensating circuit 65 corresponding to a 
data in the odd fields (image for left eye) and even fields motion vector output by the motion vector detecting circuit 
(image for right eye) are mixed, because they are being 50. That is, when the prediction determining circuit 54 
separated, and outputs them to the operator 63. 5 commands to set the forward prediction mode, the motion 

On the other hand, when the field prediction mode is set compensating circuit 65 reads out the data by shifting a read 
in the prediction mode switching circuit 52. the data sup- address in the forward prediction image section 64a from a 
plied from the motion compensating circuit 65 to the oper- position corresponding to a position in the macro-block 
ating section 53 is in the state in which the data in the odd which the motion vector detecting circuit 50 now outputs by 
fields (image for left eye) and even fields (image for right to a degree which corresponds to the motion vector to produce 
eye) are separated. Due to that, while the DCT block prediction image data. 

reordering circuit 62 supplies the data output from the IDCT The prediction image data output from the motion corn- 
circuit 61 to the operator 63 as it is when the field DCT mode pensating circuit 65 is supplied to an operator 53a. The 
is set by the DCT mode switching circuit 55. it reorders the operator 53a subtracts from the data of macro-block of the 
data when the frame DCT mode is set so that the data in the 15 reference image supplied from the prediction mode switch- 
odd fields (image for left eye) and even fields (image for ing circuit 52 the prediction image data supplied from the 
right eye) are separated, because they are being mixed, and motion compensating circuit 65 and which corresponds to 
outputs them to the operator 63. the macro-block and outputs its difference (prediction error). 

That is, the DCT block reordering circuit 62 reorders the This differential data is transmitted to the transmission path 
data output by the IDCT circuit 61 so that it is ordered in the 20 via the DCT mode switching circuit 55, DCT circuit 56, 
same manner with the order of the data supplied from the quantization circuit 57, variable length coding circuit 58 and 
motion compensating circuit 65 to the operating section 53. transmission buffer 59. This differential data is also locally 

In this case, because the data output from the IDCT circuit decoded by the inverse quantization circuit 60, IDCT circuit 
61 is I picture data, the infra-image prediction is designated *>1 and DCT block reordering circuit 62 and is then input to 
Due to that, when the DCT mode switching circuit 55 25 mc operator 63. 

outputs the frame DCT flag, the data output from the IDCT The operator 63 is supplied also with data which is same 
circuit 61 is supplied to and stored in a forward prediction with the prediction image data supplied to the operator 53a. 
image section 64a in a frame memory 64 as it is via the The operator 63 adds the prediction image data output by the 
operator 63. When the field DCT flag is output, it is motion compensating circuit 65 to the differential data 
reordered and is then stored, 30 which the DCT block reordering circuit 62 outputs. Thereby, 

When the motion vector detecting circuit 50 processes toe original (decoded) P picture image data can be obtained 
image data in each frame sequentially input respectively as The P picture image data is supplied to and stored in the 
I, B, P, B, P, B , . . picture for example, it processes, after rearward prediction image section 64b in the frame memory 
processing image data in the first input frame as I picture and 35 W. 

before processing image data in the next input frame as B The motion vector detecting circuit 50 then executes the 
picture, image data in the input frame after next as P picture, processing of B picture after storing the I and P picture data 
because decoding cannot be made if P picture as the rear- in the forward prediction image section 64a and the rear- 
ward prediction image is not prepared beforehand since B ward prediction image section 64b. The prediction mode 
picture involves a rearward prediction. ^ switching circuit 52 and the prediction dctennining circuit 

Therefore, the motion vector detecting circuit 50 starts to 54 set the frame/field mode corresponding to the value of the 
process the image data in P picture stored in the rearward absolute sum of the inter-frame difference in the unit of 
original image section 51c after processing I picture. Then, macro-block and set either intra-image prediction mode, 
the absolute sum of the inter-frame difference (prediction forward prediction mode, rearward prediction mode or 
error) with the unit of macro-block is supplied from the 45 bi-directional prediction mode. 

motion vector detecting circuit 50 to the prediction mode As described above, when the intra-image prediction 
switching circuit 52 and prediction determining circuit 54 in mode or forward prediction mode is set, the switch 53d is 
the same manner as described above. Corresponding to the switched to the contact (a) or (b). At this time, the same 
absolute sum of the prediction error in the macro-block of processing as in the case of P picture is carried out and the 
this P picture, the prediction mode switching circuit 52 and 50 data is transmitted. 

the prediction determining circuit 54 set the intra-image Contrary to that, when the rearward prediction mode or 
prediction mode, forward prediction mode, rearward prcdic- bi-directional prediction mode is set, the switch Sdd is 
tion mode or bi-directional prediction mode. switched to a contact (c) or (d). 

When the intra-image prediction mode is set, the operat- During the rearward prediction mode in which the switch 
ing section 53 switches the switch 53<* to the side of contact 55 53^is switched to the contact (c), the image (Ppicture in this 
(a) as described above. Accordingly, this data is transmitted case) data stored in the rearward prediction image section 
to the transmission path via the DCT mode switching circuit 64b is read and is motion compensated by the motion 
55, DCT circuit 56, quantization circuit 57, variable length compensating circuit 65 corresponding to a motion vector 
coding circuit 58 and transmission buffer 59 in the same output by the motion vector detecting circuit 50. That is, 
manner with the I picture data. This data is also supplied to eo when the prediction determining circuit 54 commands to set 
and stored in a rearward prediction image section 64b in the the rearward prediction mode, the motion compensating 
frame memory 64 via the inverse quantization circuit 60, circuit 65 reads out the data by shifting a read address in the 
IDCT circuit 61, DCT block reordering circuit 62 and rearward prediction image section 64b from a position 
operator 63. corresponding to a position in the macro-block which the 

When the forward prediction mode is seu the switch 53*f 65 motion vector detecting circuit 50 now outputs by a degree 
is switched to a contact (b) and the image (I picture in this which corresponds to the motion vector to produce predic- 
case) data stored in the forward prediction image section 64a tion image data. 
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The prediction image data output from the motion com- 
pensating circuit 65 is supplied to an operator 53b. The 
operator S3b subtracts the prediction image data supplied 
from the motion compensating circuit 65 from the data of 
macro-block of the reference image supplied from the 
prediction mode switching circuit 52 and outputs its differ- 
ence. This differential data is transmitted to the transmission 
path via the DOT mode switching circuit 55, DCT circuit 56, 
quantization circuit 57, variable length coding circuit 58 and 
transmission buffer 59. 

During the bi-directional prediction mode in which the 
switch 53d is switched to the contact (d). the image (image 
of I picture in this case) data stored in the forward prediction 
image section 64a and the image (image of P picture in this 
case) data stored in the rearward prediction image section 
64b are read and are motion compensated by the motion 
compensating circuit 65 corresponding to the motion vector 
output by the motion vector detecting circuit 50. 

That is, when the prediction determining circuit 54 com- 
mands to set the bi-directional prediction mode, the motion 
compensating circuit 65 reads out the data by shifting read 
addresses in the forward prediction image section 64a and 
rearward prediction image section 64b from a position 
corresponding to a position in the macro-block which the 
motion vector detecting circuit 50 now outputs by a degree 
which corresponds to the motion vectors (in this case, there 
are two motion vectors for forward prediction image and 
rearward prediction image) to produce prediction image 
data. 

The prediction image data output from the motion com- 
pensating circuit 65 is supplied to an operator 53c. The 
operator 53c subtracts an average value of prediction image 
data supplied from the motion compensating circuit 65 from 
the data of macro-block of the reference image supplied 
from the motion vector detecting circuit 50 and outputs its 
difference. This differential data is transmitted to the trans- 
mission path via the DCT mode switching circuit 55, DCT 
circuit 56, quantization circuit 57, variable length coding 
circuit 58 and transmission buffer 59. 

Because the image of B picture does not become a 
prediction image of another image, it is not stored in the 
frame memory 64. 

By the way, the banks of the forward prediction image 
section 64a and the rearward prediction image section 64b 
in the frame memory 64 may be switched as necessary and 
one stored in one or the other bank as against a predeter- 
mined reference image may be output as a forward predic- 
tion image or rearward prediction image. 

While the above explanation has been made centering on 
the luminance blocks, color-difference blocks are also pro- 
cessed and transmitted in the same manner with the unit of 
macro-blocks shown in FIGS. 9 through 12. By the way, far 
a motion vector in processing the color-difference blocks, 
one which is cut into a half of the motion vector of the 
corresponding luminance block respectively in the vertical 
and horizontal directions is used 

FIG. 13 is a block diagram showing a structure of one 
embodiment of a decoder 31 in FIG. 6. The reproduced data 
read out of the disk 68 undergoes an EFM demodulation and 
ECC processing for example and is supplied to a receiving 
buffer 81 as coded data. The coded data is temporarily stored 
in the receiving buffer 81 in the decoder and is then supplied 
to a variable length decoding circuit 82 in a decoding circuit 
90. The variable length decoding circuit 82 variable length 
decodes the data supplied from the receiving buffer 81 and 
outputs the motion vector, prediction mode, prediction flag 
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and DCT flag to a motion compensating circuit 88. It also 
outputs the quantization steps (scale) and the decoded image 
data to an inverse quantization circuit 83. It also outputs the 
DCT flag and prediction flag to a DCT block reordering 
5 circuit 85. 

The inverse quantization circuit 83 inversely quantizes the 
image data supplied from the variable length decoding 
circuit 82 in accordance to the quantization steps similarly 
supplied from the variable length decoding circuit 82 and 

10 outputs it to an IDCT circuit 84. The data (DCT coefficient) 
output from the inverse quantization circuit 83 undergoes an 
inverse DCT processing in the IDCT circuit 84 to be 
returned to the original image data. 

This image data is input to a DCT block reordering circuit 
85. The DCT block reordering circuit 85 reorders mis data 
corresponding to the DCT flag and prediction flag so that it 
is reordered in the same order of data which a motion 
compensating circuit 88 outputs to an operator 86 and 
outputs it to the operator 86. 
When the image data supplied from the DCT block 

20 reordering circuit 85 is I picture data, the data is output from 
the operator 86 and is supplied to and stored in a forward 
prediction image section 87a in a frame memory 87 to 
generate prediction image data for image data succeedingly 
input to the operator 86 (data of P or B picture). This data 

25 is also output to the format converting circuit 32 (FIG. 6). 
When the image data supplied from the DCT block 
reordering circuit 85 is data of P picture whose prediction 
image data is image data of one frame before it (two frames 
before it for the original image sequence) and is data in the 

30 forward prediction mode, image data of one frame before it 
(I picture data) stored in the forward prediction image 
section 87a in the frame memory 87 is read and is motion 
compensated by the motion compensating circuit 88 corre- 
sponding to the motion vector output from the variable 

35 length decoding circuit 82. Then, it is added with the image 
data (data of difference) supplied from the DCT block 
reordering circuit 85 in the operator 86 and is output This 
added data, ie., decoded P picture data, is supplied to and 
stored in a rearward prediction image section 87& in the 

4Q frame memory 87 to generate prediction image data for the 
image data (data of B picture or P picture) succeedingly 
input to the operator 86. 

Data in the intra-image prediction mode is not specifically 
processed in the operator 86 and is stored in the rearward 

45 prediction image section 87b as it is similarly to I picture 
data even if it is P picture data. 

Because this P picture is the image to be displayed next 
to the next B picture, it is not output to the format converting 
circuit 32 yet at this stage (as described above, P picture 

50 input after B picture is processed and transmitted before the 
B picture). 

When the image data supplied from the DCT block 
reordering circuit 85 is B picture data, image data of I picture 
stored in the forward prediction image section 87c of the 

55 frame memory 87 (in the case of the forward prediction 
mode), image data of P picture stored in the rearward 
prediction image section $7b of the frame memory 87 (in the 
case of the rearward prediction mode) or image data of the 
both (in the case of the bi-directional prediction mode) is 

60 read corresponding to the prediction mode supplied from the 
variable length decoding circuit 82 and is motion compen- 
sated in the motion compensating circuit 88 corresponding 
to the motion vector output from the variable length decod- 
ing circuit 82 to produce a prediction image. However, when 

65 no motion compensation is necessary (in the case of the 
intra-image prediction mode), no prediction image is pro- 
duced. 
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The data thus motion compensated by the motion com- ment of this case. That Is, in the present embodiment, the 

pensating circuit 88 is added with the output of the DCT image for left eye flo in the odd fields composing the frame 

block reordering circuit 85 in the operator 86. The added Fl is processed as I picture and the image for right eye fie 

output is output to the format converting circuit 32. m the even fields is processed as P picture. Then, image for 

However, because this added output is data of B picture j left eyes f2o, Ro and f4o in the odd fields and image for 

and is not used for producing a prediction image for another right eyes f2e, f3e and f4e in the even fields of the following 

image, it is not stared in the frame memory 87. frames F2 through F4 are all processed as P picture. Then, 

After when the image of B picture is output, the image while the image for right eye fie in the even field of the 

data of P picture stored in the rearward prediction image fem^ pi designates the image for left eye flo in the odd 

section 876 is read and is supplied to the format converting 10 field of me same pi a s its prediction image, the other 

^ 32 ^ ±C m0ti ° D C °^ enSatillg ™ c f *? " d image in each field designates pictures of two fields imme- 

ou^ ^toe 0WCV ^ n ° com P cnsat ™ is earned ^tidy before it as its prediction image. 

°\y the way'*altfaough circuits which correspond to the . Such prediction allows to improve the prediction effi- 

prediction mode switching circuit 52 and the DCT mode ^ ncy ftttther ^ to predicting a stereo image by 

switching circuit 55 in the encoder 18 in FIG. 8 are not frame ' 

shown in the decoder 31, the motion compensating circuit 88 FIGS. 18 and 19 show still another embodiment In the 

runs the process which corresponds to those circuits, i.e., the present embodiment, the image far left eye flo in the odd 

process for returning the composition in which signals in the field of the first frame Fl is I picture and the image for right 

odd field (image for left eye) and even field (image for right eye fie in the even field is P picture. In the next frame E2, 

eye) lines are separated to the original composition in which 20 the image for left eye f2o in the odd field and the image for 

they are mixed. right eye f2e in the even field are both processed as B picture 

While the above explanation has been made concerning and in the frame F3, the image for left eye f3o in the odd 

on the processing of luminance signals, the processing of field and the image for right eye f3e in the even field are both 

color-difference signal is carried out in the same manner. In processed as P picture. In the frames thereafter, pictures in 

this case, however, for the motion vector, one which is cut 23 °°ui fields are alternately processed as B picture orPpicture. 

into half of the motion vector for luminance signal in the The image for right eye fie in the even field of the frame 

vertical and horizontal directions is used. Fl designates the image for left eye flo in the odd field in 

In the embodiment described above, the data in the odd the same frame Fl as its prediction image. Then, P picture 

fields in which the image for left eye is disposed and the data „ * n each field of the frame F3 and thereafter designates two 

in the even fields in which the image for right eye is disposed pictures of I picture or P picture (field) immediately before 

are adaptively switched to either state of the mixed state it as its prediction image. 

(frame prediction mode or frame DCT mode) or of the B picture in each field designates I or P picture (field) 

separated state (field prediction mode or field DCT mode) immediately before or after it as its prediction image, 

and are processed in the prediction mode switching circuit 3S The unit of processing of the I picture, P picture and B 

52 and the DCT mode switching circuit 55. As a result, it picture is a field also in the present embodiment, 

allows to efficiently code without degrading the image Accordingly, the image for left eye and image for right eye 

quality as compare to the prior art case in which the image are not processed in the state wherein they are mixed and it 

for left eye and image for right eye are processed in the state becomes possible to improve the prediction efficiency more 

always mixed. ^ than the embodiment shown with reference to FIG. 17. 

FIG. 14 diagramaticalry shows the images processed by In such processing, the prediction mode switching circuit 

the erabewiiment described above. As shown in the figure, 52 and the DCT mode switching circuit 55 (and accordingly 

while each of the frames Fl through F4 are sequentially the DCT block reordering circuit 62) shown in FIG. 8 may 

processed in an order of I picture, B picture, P picture and be eliininated. Or, the field prediction mode or field DCT 

B picture, the image for left eye in the odd fields and image 45 mode may be fixed. 

for right eye in the even fields composing each frame are The video signal thus decoded by the decoding unit 2 is 

adaptively separately processed. output to and displayed on a CRT 101 shown in FIG. 20 for 

That is, an image for left eye flo in the odd field of the example. As described above, the image for left eye is 

frame F2 is predicted from at least either one of four fields disposed in the odd fields and the image for right eye is 

of an image for left eye flo in the odd field and an image far 50 disposed in the even fields, respectively in the video signal, 

right eye fie in the even field of the frame Fl which is one Due to that, a casciirnmation signal for discriminating the 

frame before it and an image for left eye f3o in the odd field odd and even fields of the video signal supplied to the CRT 

and an image for right eye f3e in the even field of the frame 101 is supplied to an electronic shutter controller 102. 

F3 which is one frame after it. The image for left eye Uo in The electronic shutter controller 102 opens a left eye 

the odd field of the frame F3 is predicted from at least either 35 shutter 103 and closes a right eye shutter 104 when the 

one of the image for left eye flo in the odd field or the image image for left eye in the odd fields is displayed on the CRT 

for right eye fie in the even field of the frame Fl which is 101 as shown in FIG. 21. It opens the right eye shutter 104 

two frames before it and c i oscs the left eye shutter 103 when the image for right 

As a result, in the field prediction mode or field DCT eye in the even fields is displayed on the CRT 101. As a 

mode, the image for right eye 206 and image for left eye 205 eo result, the image for left eye in the odd fields displayed on 

are independently processed as shown in FIGS. 15 and 16. the CRT 101 is input to a left eye 201 and the image for right 

Accordingly, it allows to eliminate die heavy interlaced eye in the even fields is input to a right eye 202: they are 

structure which corresponds to the parallax shown in FIG. forbidden from entering the other eye, respectively. As a 

23 and to code the image efficiently without degrading the result, an observer can recognize mis displayed image as a 

image quality. 65 stereo image, 

While the unit of the processing of L P or B picture has Although the image for left eye has been disposed in the 

been a frame, it may be a field. FIG. 17 shows an erabodi- odd fields and the image for right eye has been disposed in 
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the even fields in the embodiments described above, the 
image for left eye may be disposed in the even fields and the 
image for right eye may be disposed in the odd fields. 

As described above, accordingly to the present invention, 
the image for left eye and image far right eye produced by 5 
the stereoscopic are disposed respectively in the first and 
second fields of the TV signal. Then, they are predictively 
coded or DCT transformed per field. Or they are predictively 
coded or DCT transformed adaptively per field or frame. 
Accordingly* the stereo image may be efficiently coded 10 
without degrading its image quality. 

While the preferred embodiments have been described, 
variations thereto will occur to those skilled in the art within 
the scope of the present inventive concepts which are 
delineated by the following claims. 15 

What is claimed is: 

1. An image signal coding method, comprising the steps 
of: 

receiving a first image signal and a second image signal, 2Q 
said first and second image signals representing stereo- 
scopic images perceived by left and right eyes; 

producing a stereo image signal from said first and second 
image signals, said stereo image signal including 
frames, each of said frames having a first field cone- 2 s 
sponding to said first image signal and a second field 
corresponding to said second image signal; 

dividing each of said frames of said stereo image signal 
into units of blocks; 

selecting either a first prediction mode or a second pre- 30 
diction mode; 

frame prediction encoding, when said first prediction 
mode is selected, each of said frames to produce a 
predictively coded signal; 

field prediction encoding, when said second prediction 35 
mode is selected, said first and second fields of a frame 
using data from other first or second fields of a frame 
to produce said predictively coded signal; 

orthogonally transforming the predictively coded signal ^ 
to produce an orthogonally transformed signal; 

quantizing the orthogonally transformed signal to produce 
a quantized signal; and 

variable length coding the quantized signal. 

2. The image signal coding method according to claim 1 45 
wherein said stereo image signal includes groups of frames, 
each group having a plurality of frames, and the step of field 
prediction encoding is carried out by producing a predic- 
tively coded signal such that the first and second fields of a 
first one of said frames in said each group are both intrac- 50 
oded to produce intraframe encoded pictures, the first and 
second fields of a second one of said frames are both 
bidirectionaUy-pTedictively coded to produce bidirectional- 
predictive-encoded pictures, and the first and second fields 

of a third one of said frames are both predictively coded to 55 
produce predictive-encoded pictures. 

3. The image signal coding method of claim 1, wherein 
the step of field prediction encoding is carried out by field 
prediction encoding the first field of a frame from either a 
first field or a second field of one of said frames, and by field # 
prediction encoding the second field of said frame from 
either a first field or a second field of one of said frames. 

4. An image signal coding apparatus, comprising: 
means for receiving a first image signal and a second 

image signal, said first and second image signals rep- 65 
resenting stereoscopic images perceived by left and 
right eyes; 
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means for producing a stereo image signal from said first 
and second image signals, said stereo image signal 
including frames, each of said frames having a first 
field corresponding to said first image signal and a 
second field corresponding to said second image signal; 

means for dividing each of said frames of said stereo 
image signal into units of blocks 

means for selecting either a first prediction mode or a 
second prediction mode; 

means for frame prediction encoding, when said first 
prediction mode is selected, each of said frames to 
produce a predictively coded signal; 

means for field prediction encoding, when said second 
prediction mode is selected, said first and second fields 
of a frame using data from other first or second fields 
of a frame to produce said predictively coded signal; 

means for orthogonally transfonning the predictively 
coded signal to produce an orthogonally transformed 
signal; 

quantization means for quantizing the orthogonally trans- 
formed signal to produce a quantized signal; and 

variable length coding means for variable length coding 
the quantized signal. 

5. The image signal coding apparatus according to claim 
4, wherein said stereo image signal includes groups of 
frames, each group having a plurality of frames, and the step 
of field prediction encoding is carried out by producing a 
predictively coded signal such that the first and second fields 
of a first one of said frames in said each group are both 
intracoded to produce intraframe encoded pictures, the first 
and second fields of a second one of said frames are both 
bidirectionally-predictively coded to produce bidirectional- 
predictive-encoded pictures, and the first and second fields 
of a third one of said frames are both predictively coded to 
produce predictive-encoded pictures. 

6. The image signal coding apparatus of claim 4, wherein 
the means for field prediction encoding is operable to field 
prediction encode the first field of a frame from either a first 
field or a second field of one of said frames, and to field 
prediction encode the second field of said frame from either 
a first field or a second field of one of said frames. 

7. An image signal decoding method for decoding a coded 
stereo image signal produced from first and second image 
signals representing stereoscopic images perceived by left 
and right eyes, said stereo image signal including frames, 
each of said frames having a first field corresponding to said 
first image signal and a second field corresponding to said 
second image signal, each of said frames being either frame 
prediction encoded or field prediction encoded and having a 
respective prediction flag indicating the type of prediction 
coding, and each of said field prediction encoded frames 
having encoded first and second fields encoded using data 
from other first or second fields of a frame, the decoding 
method comprising steps of: 

variable length decoding the coded stereo image signal to 

produce a variable length decoded signal; 
separating each said prediction flag from said coded 

stereo image signal; 
inversely quantizing the variable length decoded signal to 

produce an inverse quantized signal; 
inverse orthogonally transforming the inverse quantized 

signal; 

producing a prediction error signal corresponding to the 
orthogonally transformed signal based on said predic- 
tion flag; and 
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decoding the orthogonally transformed signal using said 
prediction error signal. 

8. An image signal decoding apparatus for decoding a 
coded stereo image signal produced from first and second 
image signals representing stereoscopic images perceived 5 
by left and right eyes, said stereo image signal including 
frames, each of said frames having a first field corresponding 
to said first image signal and a second field corresponding to 
said second image signal, each of said frames being either 
frame prediction encoded or field prediction encoded and 
having a respective prediction flag indicating the type of 
prediction coding, and each of said field prediction encoded 
frames having encoded first and second fields encoded using 
data from other first or second fields of a frame, the decoding 
apparatus comprising: 

variable length decoding means for variable length decod- 
ing the coded stereo image signal to produce a variable 
length decoded signal and for separating each said 
prediction flag from said coded stereo image signal; 

inverse quantization means for inversely quantizing the 2 o 
variable length decoded signal to produce an inverse 
quantized signal; 

means for inverse orthogonally transforming the inverse 
quantized signal; 

producing means for producing a prediction error signal 25 
corresponding to the inverse orthogonally transformed 
signal based on said prediction flag; and 
decoding means for decoding the inverse orthogonally 
transformed signal using said prediction error signal. 

9. An image signal coding method, comprising the steps 30 
of: 

receiving a first image signal and a second image signal, 
said first and second image signals representing stereo- 
scopic images perceived by left and right eyes; 

producing a stereo image signal from said first and second 35 
image signals, said stereo image signal including 
frames, each of said frames having a first field corre- 
sponding to said first image signal and a second field 
corresponding to said second image signal; 

predictivefy coding said stereo image signal to produce a 40 
predictiveiy coded signal; 

selecting either a first transformation mode or a second 
transformation mode; 

dividing each frame of the predictiveiy coded signal into 
units of blocks, each of said blocks including data of 43 
both said first and second fields when said first trans- 
formation mode is selected, and each of said blocks 
corresponding to only one of said first and second fields 
when said second transformation mode is selected; 

orthogonally trarisforming the blocks of the predictiveiy 
coded signal to produce an orthogonally transformed 
signal; 

quantizing the orthogonally transformed signal to produce 

a quantized signal; and 55 
variable length coding the quantized signal. 

10. The image signal coding method according to claim 9, 
wherein said step of orthogonally transforming is carried out 
by discrete cosine transforming the blocks to produce a 
discrete cosine transformed signal. ^ 

11. An image signal coding apparatus, comprising: 
means for receiving a first image signal and a second 

image signal, said first and second image signals rep- 
resenting stereoscopic images perceived by left and 
right eyes; 65 
producing a stereo image signal from said first and second 
image signals, said stereo image signal including 
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frames, each of said frames having a first field corre- 
sponding to said first image signal and a second field 
corresponding to said second image signal; 
predictive coding means for predictiveiy coding said 
stereo image signal to produce a predictiveiy coded 
signal; 

means far selecting either a first transformation mode or 
a second transformation mode; 

means for dividing each frame of the predictiveiy coded 
signal into units of blocks, each of said blocks includ- 
ing data of both said first and second fields when said 
first transformation mode is selected, and each of said 
blocks corresponding to only one of said first and 
second fields when said second transformation mode is 
selected; 

means for orthogonally transforming the blocks of the 
predictiveiy coded signal to produce an orthogonally 
transformed signal; 

quantization means for quantizing the orthogonally trans- 
formed signal to produce a quantized signal; and 

variable length coding means for variable length coding 
the quantized signal. 

12. The image signal coding apparatus according to claim 
11, wherein said means for orthogonally transforming is a 
discrete cosine transformer. 

13. An image signal decoding method for decoding a 
coded stereo image signal produced from first and second 
image signals representing stereoscopic images perceived 
by left and right eyes, said stereo image signal including 
frames, each of said frames having a first field corresponding 
to said first image signal and a second field corresponding to 
said second image signal, each of said frames being divided 
into units of blocks each corresponding to both first and 
second fields of the respective frame in a first transf ormation 
mode and being divided into units of blocks each corre- 
sponding to either only said first or second field of the 
respective frame in a second transformation mode, and 
having a respective transformation flag indicating the trans- 
formation mode during coding, the decoding method com- 
prising steps of: 

variable length decoding the coded stereo image signal to 
produce a variable length decoded signal; 

separating each said transformation flag from said coded 
stereo image signal; 

inversely quantizing the variable length decoded signal to 
produce an inverse quantized signal; 

inverse orthogonally transforming the inverse quantized 
signal to produce an inverse transformed signal; 

producing a prediction error signal corresponding to the 
inverse transformed signal based on said transforma- 
tion flag; and 

decoding the inverse transformed signal using said pre- 
diction error signal. 

14. The image signal decoding method according to claim 
13, wherein said coded stereo image signal includes groups 
of frames, each group having a plurality of frames, the first 
and second fields of a first one of said frames in said each 
group are both intraframe encoded pictures, the first and 
second fields of a second one of said frames are both 
bidirectional-predictrye-encc<ic<i pictures, and the first and 
second fields of a third one of said frames are both 
predictive-encoded pictures. 

15. An image signal decoding apparatus for decoding a 
coded stereo image signal produced from first and second 
image signals representing stereoscopic images perceived 
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by left and right eyes, said stereo image signal including 
frames, each of said frames having a first field corresponding 
to said first image signal and a second field corresponding to 
said second image signal, each of said frames being divided 
into units of blocks each corresponding to both first and 
second fields of the respective frame in a first transformation 
mode and being divided into units of blocks each corre- 
sponding to either only said first or second field of the 
respective frame in a second transformation mode, and 
having a respective transformation flag indicating the trans- 
formation mode during coding, said decoding apparatus 
comprising: 

variable length decoding means for variable length decod- 
ing the coded stereo image signal and for separating 
each said transformation flag from said coded stereo 
image signal; 

inverse quantization means for inversely quantizing the 

variable length decoded signal to produce an inverse 

quantized signal; 
means for inverse orthogonally transforming the inverse 

quantized signal to produce an inverse transformed 

signal; 

producing means for producing a prediction error signal 
corresponding to the inverse transformed signal based 
on said transformation flag; and 

decoding means for decoding the inverse transformed 
signal using said prediction error signal 

16. The image signal decoding according to claim 15, 
wherein said stereo image signal includes groups of frames, 
each group having a plurality of frames, the first and second 
fields of a first one of said frames in said each group are both 
intraframe encoded pictures, the first and second fields of a 
second one of said frames are both bidirectional-predictive- 
encoded pictures, and the first and second fields of a third 
one of said frames arc both predictive-encoded pictures. 

17. An image signal coding method, comprising the steps 
of: 

receiving a first image signal and a second image signal, 
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18. The image signal coding method of claim 17, wherein 
said second field of each except the first of said frames in 
said each group is prcdictively coded using a selected one of 
said first field of the respective frame and said second field 
of a previous frame as the prediction image signal. 

19. An image signal coding apparatus, comprising the 
steps of: 

means for receiving a first image signal and a second 
image signal, said first and second image signals rep- 
resenting stereoscopic images perceived by left and 
right eyes; 

means for producing a stereo image signal from said first 
and second image signals, said stereo image signal 
including groups of frames, each group having a plu- 
rality of frames, each of said frames having a first field 
corresponding to said first image signal and a second 
field corresponding to said second image signal; 

predictive coding means for coding each said first and 
second fields of each said frame in each said group of 
said stereo image signal to produce a predictively 
coded signal, said first field in a first one of said frames 
in said each group being intracoded to produce an 
intraframe encoded picture, said second field of said 
first one of said frames being predictively coded to 
produce a predictive-encoded picture, and said first and 
second fields of a second one of said frames in said 
each group being predictively coded to produce 
predictive-encoded pictures, and said first field of said 
second frame in said each group being predictively 
coded using a selected one of said first and second 
fields of said first frame as a prediction image signal; 

means for orthogonally transforming the predictively 
coded signal to produce an orthogonally transformed 
signal; 

quantization means for quantizing the orthogonally trans- 
formed signal to produce a quantized signal; and 

variable length coding means for variable length coding 
the quantized signal. 

20. The image signal coding apparatus of claim 19. 
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scopic images perceived by left and right eyes; 

producing a stereo image signal from said first and second 
image signals, said stereo image signal including 
groups of frames, each group having a plurality of 
frames, each of said frames having a first field corre- 
sponding to said first image signal and a second field 
corresponding to said second image signal; 

coding each said first and second fields of each said frame 
in each said group of said stereo image signal to 
produce a predictively coded signal, said first field of a 
first one of said frames in said each group being 
intracoded to produce an intraframe encoded picture, 
said second field of said first one of said frames being 
predictively coded to produce a predictive-encoded 
picture, and said first and second fields of a second one 
of said frames in said each group being predictively 
coded to produce predictive-encoded pictures, and said 
first field of said second frame in said each group being 
predictively coded using a selected one of said first and 
second fields of said first frame as a prediction image 
signal; 

orthogonally transforming the predictively coded signal 
to produce an orthogonally transformed signal; 

quantizing the orthogonally transformed signal to produce 
a quantized signal; and 

variable length coding the quantized signal. 
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tively code the second field of each except the first of said 
frames in said each group using a selected one of said first 
field of the respective frame and said second field of a 
previous frame as the prediction image signal. 

21. An image signal decoding method for decoding a 
coded stereo image signal produced from first and second 
image signals representing stereoscopic images perceived 
by left and right eyes, said stereo image signal including 
groups of frames, each group having a plurality of frames, 
each of said frames having a first field corresponding to said 
first image signal and a second field corresponding to said 
second image signal, said first field in a first one of said 
frames in said each group being an intraframe encoded 
picture, said second field of said first one of said frames 
being a predictive-encoded picture, and said first and second 
fields of a second one of said frames in said each group being 
predictive-encoded pictures, and said first field of said 
second frame in said each group being predictively coded 
using a selected one of said first and second fields of said 
first frame as a prediction image signal, the decoding method 
comprising steps of: 
variable length decoding the coded stereo image signal to 

produce a variable length decoded signal; 
inversely quantizing the variable length decoded signal to 

produce an inverse quantized signal; 
inverse orthogonally transforming the inverse quantized 
signal; 
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producing a prediction error signal corresponding to the 

orthogonally transformed signal; and 
decoding the orthogonally transformed signal using said 

prediction error signaL 

22. An image signal decoding apparatus for decoding a 5 
coded stereo image signal produced from first and second 
image signals representing stereoscopic images perceived 
by left and right eyes, said stereo image signal including 
groups of frames, each group having a plurality of frames, 
each of said frames having a first field corresponding to said 10 
first image signal and a second field corresponding to said 
second image signal, said first field In a first one of said 
frames in said each group being an intrafirame encoded 
picture, said second field of said first one of said frames 
being a predictive-encoded picture, and said first and second 15 
fields of a second one of said frames in said each group being 
predictive-encoded pictures, and said first field of said 
second frame in said each group being preddctively coded 
using a selected one of said first and second fields of said 
first frame as a prediction image signal, the decoding appa- 20 
ratus comprising: 

variable length decoding means for variable length decod- 
ing the coded stereo image signal to produce a variable 
length decoded signal; 

inverse quantization means for inversely quantizing the 25 
variable length decoded signal to produce an inverse 
quantized signal; 

means for inverse orthogonally transforming the inverse 
quantized signal; 

producing means for producing a prediction error signal 
corresponding to the orthogonally transformed signal; 
and 

decoding means for decoding the orthogonally trans- 
formed signal using said prediction error signal. 35 

23. An image signal coding method, comprising the steps 
of: 

receiving a first image signal and a second image signal, 
said first and second image signals representing stereo- 
scopic images perceived by left and right eyes; 40 

producing a stereo image signal from said first and second 
image signals, said stereo image signal including 
groups of frames, each group having a plurality of 
frames, each of said frames having a first field corre- 
sponding to said first image signal and a second field 45 
corresponding to said second image signal; 

coding each said first and second fields of each said frame 
in each said group of said stereo image signal to 
produce a prcdictively coded signal, said first field of a 
first one of said frames in said each group being 20 
intracoded to produce an intraframe encoded picture, 
said second field of said first one of said frames being 
predictively coded to produce a predictive-encoded 
picture, said first and second fields of a second one of 
said frames in said each group being bidirectionally- 55 
predictively coded to produce bidfrectional-prcdictive- 
encoded pictures, and said first and second fields of a 
third one of said frames in said each group being 
predictively coded to produce predictive-encoded 
pictures, and each of said first and second fields of said 60 
second frame in said each group being bidirectionally- 
predictively coded using first and second prediction 
image signals, said first prediction image signal corre- 
sponding to a selected one of said first and second fields 
of said first frame, and said second prediction image 65 
signal corresponding to a selected one of said first and 
second fields of said third frame; 



orthogonally transforming the predictively coded signal 
to produce an orthogonally transformed signal; 

quantizing the orthogonally transformed signal to produce 
a quantized signal; and 

variable length coding the quantized signaL 

24. An image signal coding apparatus, comprising the 
steps of: 

means for receiving a first image signal and a second 
image signal, said first and second image signals rep- 
resenting stereoscopic images perceived by left and 
right eyes; 

means for producing a stereo image signal from said first 
and second image signals, said stereo image signal 
including groups of frames, each group having a plu- 
rality of frames, each of said frames having a first field 
corresponding to said first image signal and a second 
field corresponding to said second image signal; 

predictive coding means each said first and second fields 
of each said frame in each said group of said stereo 
image signal to produce a predictively coded signaL 
said first field of a first one of said frames in said each 
group being intracoded to produce an intraframe 
encoded picture, said second field of said first one of 
said frames being predictively coded to produce a 
predictive-encoded picture, said first and second fields 
of a second one of said frames in said each group being 
bidirectionally-predictively coded to produce 
bidirectional-predictive-encoded pictures, and said first 
and second fields of a third one of said frames in said 
each group being predictively coded to produce 
predictive-encoded pictures, and each of said first and 
second fields of said second frame in said each group 
being bidirectionally-predictively coded using first and 
second prediction image signals, said first prediction 
image signal corresponding to a selected one of said 
first and second fields of said first frame, and said 
second prediction image signal corresponding to a 
selected one of said first and second fields of said third 
frame; 

means for orthogonally transforming the predictively 
coded signal to produce an orthogonally transformed 
signal; 

quantization means for quantizing the orthogonally trans- 
formed signal to produce a quantized signal; and 

variable length coding means for variable length coding 
the quantized signal. 

25. An image signal decoding method for decoding a 
coded stereo image signal produced from first and second 
image signals representing stereoscopic images perceived 
by left and right eyes, said stereo image signal including 
groups of frames, each group having a plurality of frames, 
each of said frames having a first field corresponding to said 
first image signal and a second field corresponding to said 
second image signal, said first field of a first one of said 
frames in said each group being an intraframe encoded 
picture, said second field of said first one of said frames 
being a predictive-encoded picture, said first and second 
fields of a second one of said frames in said each group being 
bidirectional-predictive-encoded pictures, and said first and 
second fields of a third one of said frames in said each group 
being predictive-encoded pictures, and each of said first and 
second fields of said second frame in said each group being 
bidirectionally-predictively coded using first and second 
prediction image signals, said first prediction image signal 
corresponding to a selected one of said first and second fields 
of said first frame, and said second prediction image signal 
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corresponding to a selected one of said first and second fields 
of said third frame, the decoding method comprising steps 
of: 

variable length decoding the coded stereo image signal to 
produce a variable length decoded signal; 

inversely quantizing the variable length decoded signal to 
produce an inverse quantized signal; 

inverse orthogonally transforming the inverse quantized 
signal; 

producing a prediction error signal corresponding to the 
orthogonally transformed signal; and 

decoding the orthogonally transformed signal using said 
prediction error signal. 

26. An image signal decoding apparatus for decoding a 
coded stereo image signal produced from first and second 
image signals representing stereoscopic images perceived 
by left and right eyes, said stereo image signal including 
groups of frames, each group having a plurality of frames, 
each of said frames having a first field corresponding to said 
first image signal and a second field corresponding to said 
second image signal, said first field of a first one of said 
frames in said each group being an intraframe encoded 
picture, said second field of said first one of said frames 
being a predictive-encoded picture, said first and second 
fields of a second one of said frames in said each group being 



3,682 

26 

bidirectional-predictive-encoded pictures, and said first and 
second fields of a third one of said frames in said each group 
being predictive-encoded pictures, and each of said first and 
second fields of said second frame in said each group being 
5 bidirectionally-predictrvely coded using first and second 
prediction image signals, said first prediction image signal 
corresponding to a selected one of said first and second fields 
of said first frame, and said second prediction image signal 
corresponding to a selected one of said first and second fields 
10 of said third frame, the decoding apparatus comprising: 
variable length decoding means for variable length decod- 
ing the coded stereo image signal to produce a variable 
length decoded signal; 
inverse quantization means for inversely quantizing the 
15 variable length decoded signal to produce an inverse 
quantized signal; 

means for inverse orthogonally transforming the inverse 
quantized signal; 
20 producing means for producing a prediction error signal 
corresponding to the orthogonally transformed signal; 
and 

decoding means for decoding the orthogonally trans- 
formed signal using said prediction error signal. 

25 
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